Smart Context Subsampling On-Device System

ABSTRACT

The present disclosure provides a system for intelligently sampling information, such as location, activities, etc. on device. Sampling and uploading of background context is optimized using machine learning, such that battery usage is reduced, and quality of metrics based on the reported information is maintained or improved. A policy is generated based on the machine learning, the policy dictating how scanning and upload rates should change in response to conditions on the device.

BACKGROUND

Currently, mobile devices may periodically sample and uploadinformation, such as location information, to a remote server. Suchinformation may be used in various applications, such as navigation,statistics, etc. Such reporting can, however, impact battery life of themobile devices. In some systems, reporting rates are adjusted accordingto a simple set of heuristics, such as every 10 minutes if the deviceseems to be moving, or every 60 minutes if the device seems to be still.However, reporting in such manner is suboptimal, because it wastesbattery by sampling location information that is redundant oruninteresting, and not sampling enough where the information would bemore useful.

BRIEF SUMMARY

The present disclosure provides a system for intelligently samplinginformation, such as location, activities, etc. on device. Sampling anduploading of background context is optimized using machine learning,such that battery usage is reduced, and quality of metrics based on thereported information is maintained or improved. A policy is generatedbased on the machine learning, the policy dictating how scanning andupload rates should change in response to conditions on the device.

One aspect of the disclosure provides a method for improving reporting.The method includes receiving, from a plurality of mobile computingdevices, data over a first time period, identifying, based on thereceived data, trigger conditions for reporting information, such thatlimiting reporting to the trigger conditions reduces consumption ofbattery power while preserving quality of the data, the triggerconditions including activities detected by the mobile computingdevices, and generating, using the received data and the identifiedtrigger conditions, a policy for reporting the information. The policyis provided to one or more mobile computing devices for execution.

In some examples, the data includes detected conditions andcorresponding timestamp information. Reporting the information mayinclude at least one of sampling the information or uploading theinformation to a remote server. Identifying the trigger conditions forreporting information may include executing a machine learning model.Identifying the trigger conditions for reporting information may alsoinclude training the received data against a cost function. The costfunction may be based on a battery cost associated with power requiredto report the information, an offset cost associated with a distancebetween a previously reported location of the mobile computing deviceand a current location, and a path reconstruction cost. Training thereceived data may include using a tabular representation. The costfunction may represent an expected total future cost of performing aparticular action when one of the mobile computing devices is in aparticular state. In some instances, the method may further includereceiving additional data from the plurality of mobile computing devicesover a second time period, updating the generated policy based on theadditional data, and providing the updated policy to the one or moremobile computing devices for execution.

Another aspect of the disclosure provides a method for reporting by amobile computing device. This method includes receiving, at the mobilecomputing device, a policy identifying one or more trigger conditionsfor reporting information, detecting, by the mobile computing device, anactivity associated with the mobile computing device, determiningwhether the detected activity corresponds to the one or more triggerconditions, and reporting information when the detected activitycorresponds to the one or more trigger conditions. Reporting theinformation may include at least one of sampling the information oruploading the information to a remote server. Detecting the activity mayinclude detecting one or more conditions, such as connectivityconditions or movement conditions.

Another aspect of the disclosure provides a system for improvingreporting. The system includes a memory storing data reported by aplurality of mobile computing devices over a first period of time, andone or more processors in communication with the memory. The one or moreprocessors are configured to identify, based on the stored data, triggerconditions for reporting information, such that limiting reporting tothe trigger conditions reduces consumption of battery power of reportingdevices while preserving quality of the data, the trigger conditionsincluding activities detected by the mobile computing devices, generate,using the stored data and the identified trigger conditions, a policyfor reporting the information, and provide the policy to one or moremobile computing devices for execution.

In some examples, the data includes detected conditions andcorresponding timestamp information. Reporting information may includeat least one of sampling the information or uploading the information toa remote server. Identifying the trigger conditions for reportinginformation may include executing a machine learning model. Identifyingthe trigger conditions for reporting information may include trainingthe stored data against a cost function. The cost function may representan expected total future cost of performing a particular action when oneof the mobile computing devices is in a particular state.

In some examples, the one or more processors are further configured toreceive additional data from the plurality of mobile computing devicesover a second time period, update the generated policy based on theadditional data, and provide the updated policy to the one or moremobile computing devices for execution.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram of an example system according to aspects ofthe disclosure.

FIG. 2 is a block diagram of an example device and conditions accordingto aspects of the disclosure.

FIG. 3 is an example flow diagram illustrating transmission ofinformation according to aspects of the disclosure.

FIG. 4 illustrates an example of path reconstruction according toaspects of the disclosure.

FIG. 5 is a flow diagram illustrating an example method according toaspects of the disclosure.

FIG. 6 is a flow diagram illustrating another example method accordingto aspects of the disclosure.

DETAILED DESCRIPTION

The present disclosure provides a machine learning approach foroptimizing reporting by mobile devices. Sampling and uploading ofbackground context is optimized, such that battery usage is reduced, andquality of metrics based on the reported information is maintained orimproved. A policy is generated based on the machine learning, thepolicy dictating how scanning and upload rates should change in responseto conditions on the device. For example, the machine learning is usedto determine particular trigger conditions, which, when detected by amobile device, cause the mobile device to report data. The reporting mayinclude sampling and/or uploading. Sampling may be performed in responseto some trigger conditions while uploading is performed in response toothers. The trigger conditions may be particular activities inferred bysensor data, such as driving, parking, jogging, shopping, etc.

Example Systems

FIG. 1 illustrates an example system for optimizing reporting by mobiledevices. It should not be considered as limiting the scope of thedisclosure or usefulness of the features described herein. In thisexample, system 100 can include computing devices 110 in communicationwith one or more client devices 160, 170, as well as storage system 140,through network 150. Each computing device 110 can contain one or moreprocessors 120, memory 130 and other components typically present ingeneral purpose computing devices. Memory 130 of each of computingdevice 110 can store information accessible by the one or moreprocessors 120, including instructions 134 that can be executed by theone or more processors 120.

Memory 130 can also include data 132 that can be retrieved, manipulatedor stored by the processor. The memory can be of any non-transitory typecapable of storing information accessible by the processor, such as ahard-drive, memory card, ROM, RAM, DVD, CD-ROM, write-capable, andread-only memories.

The instructions 134 can be any set of instructions to be executeddirectly, such as machine code, or indirectly, such as scripts, by theone or more processors. In that regard, the terms “instructions,”“application,” “steps,” and “programs” can be used interchangeablyherein. The instructions can be stored in object code format for directprocessing by a processor, or in any other computing device languageincluding scripts or collections of independent source code modules thatare interpreted on demand or compiled in advance. Functions, methods,and routines of the instructions are explained in more detail below.

Data 132 may be retrieved, stored or modified by the one or moreprocessors 220 in accordance with the instructions 134. For instance,although the subject matter described herein is not limited by anyparticular data structure, the data can be stored in computer registers,in a relational database as a table having many different fields andrecords, or XML documents. The data can also be formatted in anycomputing device-readable format such as, but not limited to, binaryvalues, ASCII or Unicode. Moreover, the data can comprise anyinformation sufficient to identify the relevant information, such asnumbers, descriptive text, proprietary codes, pointers, references todata stored in other memories such as at other network locations, orinformation that is used by a function to calculate the relevant data.

The one or more processors 120 can be any conventional processors, suchas a commercially available CPU. Alternatively, the processors can bededicated components such as an application specific integrated circuit(“ASIC”) or other hardware-based processor. Although not necessary, oneor more of computing devices 110 may include specialized hardwarecomponents to perform specific computing processes, such as imagerecognition, object recognition, image encoding, tagging, etc.

Although FIG. 1 functionally illustrates the processor, memory, andother elements of computing device 110 as being within the same block,the processor, computer, computing device, or memory can actuallycomprise multiple processors, computers, computing devices, or memoriesthat may or may not be stored within the same physical housing. Forexample, the memory can be a hard drive or other storage media locatedin housings different from that of the computing devices 110.Accordingly, references to a processor, computer, computing device, ormemory will be understood to include references to a collection ofprocessors, computers, computing devices, or memories that may or maynot operate in parallel. For example, the computing devices 110 mayinclude server computing devices operating as a load-balanced serverfarm, distributed system, etc. Yet further, although some functionsdescribed below are indicated as taking place on a single computingdevice having a single processor, various aspects of the subject matterdescribed herein can be implemented by a plurality of computing devices,for example, in the “cloud.” Similarly, memory components at differentlocations may store different portions of instructions 134 andcollectively form a medium for storing the instructions. Variousoperations described herein as being performed by a computing device maybe performed by a virtual machine. By way of example, instructions 134may be specific to a first type of server, but the relevant operationsmay be performed by a second type of server running a hypervisor thatemulates the first type of server. The operations may also be performedby a container, e.g., a computing environment that does not rely on anoperating system tied to specific types of hardware.

Each of the computing devices 110, 160, 170 can be at different nodes ofa network 150 and capable of directly and indirectly communicating withother nodes of network 150. Although only a few computing devices aredepicted in FIG. 1, it should be appreciated that a typical system caninclude a large number of connected computing devices, with eachdifferent computing device being at a different node of the network 150.The network 150 and intervening nodes described herein can beinterconnected using various protocols and systems, such that thenetwork can be part of the Internet, World Wide Web, specific intranets,wide area networks, or local networks. The network can utilize standardcommunications protocols, such as Ethernet, WiFi, HTTP, protcolsdescribed in IEEE 802.11, cellular technology (such as GSM, CDMA, UMTS,EV-DO, WiMAX, LTE, etc.) protocols that are proprietary to one or morecompanies, and various combinations of the foregoing. Although certainadvantages are obtained when information is transmitted or received asnoted above, other aspects of the subject matter described herein arenot limited to any particular manner of transmission of information.

As an example, each of the computing devices 110 may include web serverscapable of communicating with storage system 140 as well as computingdevices 160, 170 via the network 150. For example, one or more of servercomputing devices 110 may use network 150 to transmit and presentinformation to a user on a display, such as display 165 of computingdevice 160. In this regard, computing devices 160, 170 may be consideredclient computing devices and may perform all or some of the featuresdescribed herein.

Each of the client computing devices 160, 170 may be configuredsimilarly to the server computing devices 110, with one or moreprocessors, memory and instructions as described above. Each clientcomputing device 160, 170 may be a mobile computing device intended foruse by a user and capable of wirelessly exchanging data with a serverover a network such as the Internet. By way of example only, clientcomputing device 160 may be a mobile phone or a device such as awireless-enabled PDA, a tablet PC, a netbook, a smart watch, ahead-mounted computing system, or any other device that is capable ofobtaining information via the Internet. As an example the user may inputinformation using a small keyboard, a keypad, microphone, using visualsignals with a camera, or a touch screen, etc.

The client computing devices 160, 170 may have all of the componentsnormally used in connection with a mobile computing device such as aprocessor, memory (e.g., RAM and internal hard drives) storing data andinstructions, a display such as display 165, and user input device 166(e.g., input buttons, touch-screen, microphone, etc.). The clientcomputing device may also include one or more sensors 167 for detectingconditions surrounding the mobile device. For example, the sensors 167may include an image capture device, such as a camera for recordingvideo streams and/or capturing images, speakers, a network interfacedevice, and all of the components used for connecting these elements toone another. The sensors 167 may also include a location determinationsystem, such as a GPS. Other examples of location determination systemsmay determine location based on wireless access signal strength, imagesof geographic objects such as landmarks, semantic indicators such aslight or noise level, etc.

As will be described in further detail below in connection with FIG. 2,the client computing devices 160, 170 may sample information regardingsurrounding conditions, such as by using the sensors 167, and may uploadsuch information to the server 110 and/or the storage system 140. Suchsampling or uploading may more generally be referred to as reporting.The client computing devices 160, 170 each have a privacy setting, whichmust be set to authorize such reporting. For example, a user of theclient computing devices 160, 170 has an option to turn such reportingon or off, and may have an option to select which types of informationare reported and which types are not. By way of example only, the usermay allow reporting of an identification of connected access points, butnot reporting of GPS coordinates. Moreover, privacy protections areprovided for any data transmitted by the mobile device, including, forexample, anonymization of personally identifiable information,aggregation of data, filtering of sensitive information, encryption,hashing or filtering of sensitive information to remove personalattributes, time limitations on storage of information, or limitationson data use or sharing. For example, detailed location information mayonly be stored for a relatively short-lived period of time in thestorage system 140. Moreover, data may be anonymized and aggregated suchthat individual user data is not revealed. Rather than using anypersonal information to uniquely identify a mobile device, a hash of aunique identifier may be used. For example, the hash may be acryptographic hash. The hash may have a high collision rate. The hashmay be applied to a unique number or text string associated with mobiledevice. In this regard, no personal information is stored.

As with memory 130, storage system 140 can be of any type ofcomputerized storage capable of storing information accessible by theserver computing devices 110, such as a hard-drive, memory card, ROM,RAM, DVD, CD-ROM, write-capable, and read-only memories. In addition,storage system 140 may include a distributed storage system where datais stored on a plurality of different storage devices which may bephysically located at the same or different geographic locations.Storage system 140 may be connected to the computing devices via thenetwork 150 as shown in FIG. 1 and/or may be directly connected to anyof the computing devices 110.

Storage system 140 may store data, such as reports from the clientcomputing devices 160, 170 where privacy settings on the clientcomputing devices 160, 170 have been set to authorize reporting. Thereports may include, for example, location information, conditioninformation, activity information, connectivity information, geofenceinformation, battery information, or a variety of other types ofinformation. The location information may include information such asGPS coordinates, nearby points of interest, or the like. Conditioninformation may include, for example, weather information, detectedlight levels, sounds, air pressure, vibrations, etc. Activityinformation may include information determined based on detectedconditions, location, or other information. For example, activities mayinclude shopping, jogging, dining, etc. In some examples, the activityinformation may identify applications in use by the mobile computingdevice 160, 170. Connectivity information may include, by way ofexample, a Wi-Fi connection state, identification of connected accesspoints, such as by MAC address, etc. In some example, the connectivityinformation may also include beacon scans from nearby devices. Geofenceinformation may identify whether the mobile device 160, 170 is within ageographic area that corresponds to a residence or workplace. The device160, 170 may in some examples suppress reporting of information when thedevice 160, 170 is within a home or work geofence. The batteryinformation may identify a current battery level of the mobile computingdevice 160, 170, or whether the device is in a charging state.

FIG. 2 is a block diagram of an example device and conditions accordingto aspects of the disclosure. As mentioned above, the client device 160includes processor 162, memory including data 163 and instructions 164,and one or more sensors 167.

The instructions 164 are executable by the processor 162, for example,to perform a method including receiving a policy for reportinginformation, detecting surrounding conditions or activities, determiningwhether the detected condition or activity triggers reporting ofinformation in accordance with the policy, and report information whenit is triggered. The reporting may including at least one of samplingdata or uploading information, or both. According to some examples, afirst condition or activity may trigger the sampling of data, while asecond different condition or activity triggers uploading information.

The sensors 167 may include, by way of example and not limitation, agyroscope, accelerometer, magnetometer, GPS, camera, microphone, lightsensor, motion sensor, etc. Such sensors may be used to detect a varietyof different conditions, such as movement, weather conditions, sounds,nearby objects, electromagnetic fields, etc. The sensors 167 may in someexamples recognize detailed information relating to the conditions. Forexample, the gyroscope and accelerometer may not only detect whether thedevice 160 is moving or not, but may determine whether the movement islinear or rotational, a direction of the movement, a speed of themovement, etc. Information from different types of the sensors 167 mayalso be used to determine conditions or activities. For example, a lowreading from a light sensor in combination with a high pressure readingfrom a barometer may indicate rain. As another example, a particularspeed and level of vibration may indicate that the device 160 istraveling on a bicycle, while received sounds or smells indicate thatthe device 160 is passing a restaurant.

The device 160 further includes an input/output (I/O) interface 169. I/Ointerface 169 may provide for communication, using analog or digitalmodulation, between the computing device 160 and other devices ornetworks. The I/O interface 169 may facilitate circuit-switched and/orpacket-switched communication. For instance, I/O interface 169 mayinclude a chipset and antenna arranged for wireless communication with aradio access network or an access point. I/O interface 169 may include awireline interface, such as an Ethernet, Universal Serial Bus (USB), orHigh-Definition Multimedia Interface (HDMI) port. I/O interface 169 mayalso include a wireless interface, such as a Wi-Fi, or wide-areawireless interface (e.g., WiMAX or 3GPP Long-Term Evolution (LTE)).Other forms of physical layer interfaces and other types ofcommunication protocols may also be used. Furthermore, I/O interface 169may comprise multiple physical communication interfaces (e.g., a Wifiinterface, a short range wireless interface, and a wide-area wirelessinterface), and may enable multiple simultaneous connections ofdifferent types.

The I/O interface 169 may be used to establish connectivity with one ormore other computing devices. For example, in addition to the network150, storage system 140, and server 110 discussed in connection withFIG. 1 above, the I/O interface 169 may be used to establish connectionswith access points, such as cellular access points 220, Wi-Fi accesspoints 225, or any other type of access point with which the device 160may establish a connection. The I/O interface may further establishconnection with one or more other mobile computing devices 232, 234. TheI/O interface 169 may further be used to detect beacons or radiofrequency identification (RFID) tags, which may be positioned at any ofa number of locations for any of a variety of reasons. For example, suchbeacons or RFID tags may be positioned in stores to determine a numberof potential customers, in an advertising space to determine a number ofviewers of the advertisement, etc.

I/O interface 169 may be used to determine connectivity information,which may further be used to determine conditions or activitiesassociated with the device 160. For example, a number of other computingdevices moving in close proximity with the device 160 may suggest thatthe device 160 is on a public train or a busy sidewalk. More precisedeterminations can be made when combined with other sensor information,such as noise level, vibrations, speed, etc. As another example, anumber of other detected computing devices in close proximity, but aweak GPS signal and low light level, may suggest that the device 160 isin a locker room at a fitness club. In further examples, anidentification of a particular access point, such as a MAC address, mayprovide location information or suggest a particular activity, such aseating at a restaurant associated with the MAC address of the accesspoint.

While several examples of how various types of detected information canbe used separately or in combination to determine conditions surroundingthe device 160 or activities, it should be understood that any number ofvarious activities or conditions can be determined using various inputs.

The policy generated by the server 110 may determine that it is mostuseful and cost effective for the mobile device 160 to only reportinformation under a particular set of conditions or activities. By wayof example only, the device 160 may only sample information when itdetermines that it is moving in a public place, and has more than afirst predetermined percentage of battery life. As another example, thedevice 160 may only sample if there are at least a predetermined numberof points of interest within a predetermined range. As another example,the device 160 may pause sampling and only resume sampling once a changein weather conditions is detected. As yet a further example, the device160 may only upload information when it is connected to a power sourceor has greater than a second predetermined percentage of battery life.

FIG. 3 is an example flow diagram illustrating transmission ofinformation according to aspects of the disclosure. Various datagathered by mobile devices 360, with user permission, is transmitted todatabase 340. The data may be transmitted with a correspondingtimestamp, such as a timestamp indicating when the information wassampled. The database 340 may collect data from various sources over anextended period of time. Though not shown, the database 340 may beavailable to any of the number of systems and applications that use suchdata for various purposes. For example, the database 340 may beaccessible by maps-related applications, navigation-relatedapplications, weather-related applications, advertising-relatedapplications, etc.

All or a portion of the data stored in database 340 may be used bymachine learning system 320 to identify trigger activities or conditionsfor reporting data by a mobile device. The trigger activities orconditions may be identified such that limiting reporting, includingsampling and/or upload, of data to the trigger activities/conditionswould optimize battery life of the mobile device as well as usefulnessof the data. For example, regarding usefulness of the data, it may bedetermined whether an accuracy and frequency and quantity of the data issufficient to accurately infer location and activity data. Thesufficiency of the data reported in response to the trigger conditionsor activities should, for example, be comparable to data reportedirrespective of a battery life optimization.

According to some examples, the machine learning system 320 may simulatedifferent sampling and upload strategies as if they were running on amobile device. For example, reporting policies generated based on datain the database 340 may be tested and evaluated prior to executing thereporting policies on the mobile devices 360. The machine learningsystem 320 may run an initial policy determined based on data existingin the database 340, and allow learning to explore new policies bysimulating new location histories. In some examples, new policies may beexplored simultaneously with the evaluation of other policies.

The machine learning may include training of the data using a costfunction, for example, planning for total expected future cost. In someexamples, the cost function may incorporate full semantic location andactivity inferences, as well as actual amount of battery used. In otherexamples, a simplified cost function may be used for fast computationwhile approximating a same quality of metrics. For example, the costfunction may be a sum of distinct sub-costs, such as battery, offset,and path reconstruction. In some examples, additional sub-costs mayinclude Wi-Fi and detected activity reports, as discussed further below.Accordingly, a cost function may be:

C(a, s, L)=αBB(L′)+αOO(L, L′)+αRR(L, L′)

In this equation, C(a,s,L) is the cost of performing an action a when adevice is in state s as computed from historic data L. Tuning parametersα provide for representation of a relative importance of each of thesub-costs. Not all costs will apply to all actions. For example, somecosts may only apply to upload actions and not to sampling rate changes.While battery costs may apply to all actions, for example, offset costsand path reconstruction costs may only apply to uploading. Because themachine learning system 320 is optimizing for total expected futurecost, it should learn, for example, that bad sampling rates eventuallylead to bad upload costs.

The battery costs may represent simple relative power costs for eachaction. The battery costs may be estimated from a number of locationreports, and a frequency of batching.

The offset cost may be a distance d from a last uploaded location, lu,to a user's current, actual location. The offset cost function may be:

${O( {L,L^{\prime}} )} = {\frac{1}{T - u}{\sum\limits_{t = {u + 1}}^{T}\; {d( {l_{u},l_{t}} )}}}$

Since the user's current location is unknown, it may be approximatedwith each location lt in the database 340 from a time of the last uploadu to a time of current upload T. In some examples, the model uploadsonce per batch, such that the batching rate directly controls the uploadrate. However, it should be understood that uploading and batching ratesmay be independent,

Offset will be high when the user is moving. The battery cost of uploadactions should prevent the system from learning to upload toofrequently, and will find a more nuanced balance between speed of motionand upload rates, as opposed to a hard threshold. The distance may benormalized by an estimated velocity of the device. For example:

${\hat{O}( {L,L^{\prime}} )} = {\frac{1}{T - u}{\sum\limits_{t = {u + 1}}^{T}\; {{d( {l_{u},l_{t}} )}\text{/}v_{t}}}}$

where vt=d(l_(t), l_(t-1))/(c_(t)−c_(t-1)) is the estimated velocity ofthe device at time t (and c_(t) is the timestamp of l_(t)). The units ofÔ are time, and it can be thought of as the “effective freshness” ofl_(u). As such, when the device is moving slowly, the offset counts morethan when the device is moving quickly.

Path reconstruction cost relates to an ability to reconstruct a user'spath based on a sufficiency of location reports in an upload. The pathreconstruction cost can be defined as:

$ \mspace{79mu} {{R( {L,L^{\prime}} )} = {\frac{1}{{L} - {L^{\prime}}}{\sum{\text{?}\; {d( {l,k,m} )}}}}} )$?indicates text missing or illegible when filed

where L is the full set of location reports and L′ is the set oflocation reports with some reports omitted.

In FIG. 4, points 411-416 and 421-428 represent a full set of locationreports, which may each have corresponding timestamps, enabling areconstruction of a user's path from one point to the next. Somereports, and thus points, are omitted to determine a model for reducedreporting, and a new path is generated connecting the points 411-416. Inthe example shown, points 411-416 represent locations in reportsretained in L′. Points 421-428 represent locations in dropped reports.For a point 1 in L but not in L′, k and m are the points in L′immediately before and after 1 (in time). d is the distance that 1 hasto be moved to fall onto the line segment (where linear interpolationwould put it) between k and m. For example, in FIG. 4, lines 431-436 aredropped, and new lines 441-443 are created to connect the remainingpoints 411-416. Distance lines 451-453 represent the distance d thateach respective dropped point 421-428 must be move to align with newpath lines 441-443. R(L, L′) in the equation above represents an averagelength of lines 451-453. Distances below a threshold may be ignored sothat the path reconstruction cost has no effect on points discarded whenthe device is mostly stationary.

Another example cost is a Wi-Fi report cost. When a user is in aplace-dense area, the policy should receive enough WiFi scans to assistplace inference. The WiFi report cost can be defined as the cosinesimilarity between the mean WiFi vectors built from the set of filteredand unfiltered scans:

W(L, L′)=w(L′)·w(L)/∥w(L′)∥ ∥w(L)∥

where w(L) is the average of all WiFi scans in set L. In other examples,the Wi-Fi report cost can be determined based on how much space of Wi-Fiscans is traversed, analogous to the path reconstruction cost.

Similar to how WiFi scans are used in place inference, detected activityreports (DARs) may be used in activity inference. The machine learningsystem 320 may ensure that enough DARs are included in an upload so thatactivity and place can still be accurately inferred.

While a number of types of cost have been described above, it should beunderstood that a variety of other types of cost may additionally oralternatively be used for training data from the database 340.

The machine learning system 320 executes a machine learning model, whichlearns the expected total future cost of performing an action. The modelitself could be a neural network, a simple linear model, or even atable-lookup. Any regression method capable of learning the costfunction can be considered. Once an estimate of the cost function hasbeen fit, it can be turned into a policy by always choosing the actionthat minimizes the cost in a given state s. Example models includetabular regression models, linear models, etc.

A training procedure for a tabular model may follow a procedure for eachdevice in a subset of history data in the database 340. For example, thetraining procedure may initialize the cost function with all zeros, andrepeat a sequence of (i) running a policy defined by the cost functionfor one action and observing a resulting state and a cost, and (2)updating the cost function. The updated cost function may be Q(s,a)=Q(s,a)+λ[(c+γQ(s′, a′))−Q(s, a)], where a′ is the action that maximizesQ(s′,a′) and λ is a learning rate. This sequence may be repeated untilconvergence. Convergence may be reached when a maximum change to anyQ(s,a) falls below a pre-specified threshold.

As mentioned above, the policies can be evaluated prior toimplementation in the mobile devices 360. For example, the policies maybe evaluated at servers 310, using simulated data, and furtheradjustments to the policies may be made based on the evaluation.

When a battery-saving, quality-neutral policy is identified it can belaunched and provided to the mobile devices 360. We can then trackreal-world battery impact and data quality can be determined based onexecution of the policy by the mobile devices 360.

Example Methods

Further to the example systems described above, example methods are nowdescribed. Such methods may be performed using the systems describedabove, modifications thereof, or any of a variety of systems havingdifferent configurations. It should be understood that the operationsinvolved in the following methods need not be performed in the preciseorder described. Rather, various operations may be handled in adifferent order or simultaneously, and operations may be added oromitted.

FIG. 5 is a flow diagram illustrating an example method 500 according toaspects of the disclosure. The method 500 may be performed by, forexample, one or more server computing devices and/or machine learningsystems.

In block 510, time-related input information, such as timestamped data,is received from a plurality of mobile computing devices. Thetime-related input information may be temporarily stored in a databaseprior to be received at the server/machine learning system. The dataincludes only information authorized by users of the mobile devices.Moreover, privacy protections are provided for any user data transmittedby the mobile device, including, for example, anonymization ofpersonally identifiable information, aggregation of data, filtering ofsensitive information, encryption, hashing or filtering of sensitiveinformation to remove personal attributes, time limitations on storageof information, or limitations on data use or sharing. Moreover, datamay be anonymized and aggregated such that individual user data is notrevealed. No personal information is stored.

In block 520, trigger conditions are identified based on thetime-related input information. For example, a machine learning model isexecuted using the received time-related input information. The modelmay apply a cost function, such that the model is trained to minimizecost while optimizing quality of reported data. The cost function may bebased on one or more different types of costs, such as costs relating todifferent types of data. For example, the cost may relate to locationdata, activity data, etc. Any of a variety of machine learning modelsmay be used, such as a tabular regression model, a linear model, etc. Asa result of the model, it may be determined which conditions oractivities should trigger a report of data by a mobile computing device,such that a battery life of the mobile computing device is preservedwhile most useful data is reported.

In block 530, a policy is generated for reporting information based onthe identified trigger conditions. For example, the policy may dictatethat a mobile device samples information when a first trigger conditionis detected, and uploads information when a second trigger condition isdetected.

In block 540, the policy may be provided to one or more mobile devicesfor execution. When executed by the mobile devices, the reported datamay be used to further train the machine learning model. In this regard,the policy may be further refined and updated.

FIG. 6 is a flow diagram illustrating another example method 600according to aspects of the disclosure. The method 600 may be performedby, for example, a mobile computing device.

In block 610, a policy is received, the policy indicating one or moretrigger conditions for reporting information. The policy may be, forexample, the policy generated in block 530 of FIG. 5.

In block 620, the mobile computing device detects surroundingconditions. The conditions may include, for example, weather conditions,connectivity information, location, sounds, vibration, movements, etc.

In block 630, the mobile computing device may determine an activitycorresponding to the detected conditions. For example, it may bedetermined based on particular connected devices, movement, etc. that auser of the mobile computing device is walking around a shopping mall orperforming another activity.

In block 640, it is determined whether the detected activity correspondsto a trigger condition in the policy. If so, the method 600 proceeds toreport information in block 650. For example, the device may sampledata, or upload a batch of sampled data. In no detected conditionscorrespond to trigger conditions in the received policy, however, themethod 600 may return to block 620 and continue detecting surroundingconditions.

The example systems and methods described above are beneficial in thatthey provide for reducing battery consumption, while still providing forobtaining accurate and useful information. Moreover, by reducing thereported information, resources such as network bandwidth and databasestorage may be conserved.

Unless otherwise stated, the foregoing alternative examples are notmutually exclusive, but may be implemented in various combinations toachieve unique advantages. As these and other variations andcombinations of the features discussed above can be utilized withoutdeparting from the subject matter defined by the claims, the foregoingdescription of the embodiments should be taken by way of illustrationrather than by way of limitation of the subject matter defined by theclaims. In addition, the provision of the examples described herein, aswell as clauses phrased as “such as,” “including” and the like, shouldnot be interpreted as limiting the subject matter of the claims to thespecific examples; rather, the examples are intended to illustrate onlyone of many possible embodiments. Further, the same reference numbers indifferent drawings can identify the same or similar elements.

1. A method for improving reporting, the method comprising: receiving,from a plurality of mobile computing devices, data over a first timeperiod; identifying, based on the received data, trigger conditions forreporting information, such that limiting reporting to the triggerconditions reduces consumption of battery power while preserving qualityof the data, the trigger conditions including activities detected by themobile computing devices; generating, using the received data and theidentified trigger conditions, a policy for reporting the information;and providing the policy to one or more mobile computing devices forexecution.
 2. The method of claim 1, wherein the data includes detectedconditions and corresponding timestamp information.
 3. The method ofclaim 1, wherein reporting information comprises at least one ofsampling the information or uploading the information to a remoteserver.
 4. The method of claim 1, wherein identifying the triggerconditions for reporting information comprises executing a machinelearning model.
 5. The method of claim 1, wherein identifying thetrigger conditions for reporting information comprises training thereceived data against a cost function.
 6. The method of claim 5, whereinthe cost function is based on a battery cost associated with powerrequired to report the information, an offset cost associated with adistance between a previously reported location of the mobile computingdevice and a current location, and a path reconstruction cost.
 7. Themethod of claim 5, wherein training the received data comprises using atabular representation.
 8. The method of claim 7, wherein the costfunction represents an expected total future cost of performing aparticular action when one of the mobile computing devices is in aparticular state.
 9. The method of claim 1, further comprising:receiving additional data from the plurality of mobile computing devicesover a second time period; updating the generated policy based on theadditional data; and providing the updated policy to the one or moremobile computing devices for execution.
 10. A method for reporting by amobile computing device, the method comprising: receiving, at the mobilecomputing device, a policy identifying one or more trigger conditionsfor reporting information; detecting, by the mobile computing device, anactivity associated with the mobile computing device; determiningwhether the detected activity corresponds to the one or more triggerconditions; and reporting information when the detected activitycorresponds to the one or more trigger conditions.
 11. The method ofclaim 10, wherein the reporting information comprises at least one ofsampling the information or uploading the information to a remoteserver.
 12. The method of claim 10, wherein detecting the activitycomprises detecting one or more conditions, including connectivityconditions.
 13. The method of claim 10, wherein detecting the activitycomprises detecting one or more conditions, including movementconditions.
 14. A system for improving reporting, comprising: a memorystoring data reported by a plurality of mobile computing devices over afirst period of time; one or more processors in communication with thememory, the one or more processors configured to: identify, based on thestored data, trigger conditions for reporting information, such thatlimiting reporting to the trigger conditions reduces consumption ofbattery power of reporting devices while preserving quality of the data,the trigger conditions including activities detected by the mobilecomputing devices; generate, using the stored data and the identifiedtrigger conditions, a policy for reporting the information; and providethe policy to one or more mobile computing devices for execution. 15.The system of claim 14, wherein the data includes detected conditionsand corresponding timestamp information.
 16. The system of claim 14,wherein reporting information comprises at least one of sampling theinformation or uploading the information to a remote server.
 17. Thesystem of claim 14, wherein identifying the trigger conditions forreporting information comprises executing a machine learning model. 18.The system of claim 14, wherein identifying the trigger conditions forreporting information comprises training the stored data against a costfunction.
 19. The system of claim 18, wherein the cost functionrepresents an expected total future cost of performing a particularaction when one of the mobile computing devices is in a particularstate.
 20. The system of claim 14, wherein the one or more processorsare further configured to: receive additional data from the plurality ofmobile computing devices over a second time period; update the generatedpolicy based on the additional data; and provide the updated policy tothe one or more mobile computing devices for execution.